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Abstract. Adaptive response to a varying environment is a common feature of 
biological organisms. Reproducing such features in electronic systems and circuits 
is of great importance for a variety of applications. Here, we consider memory 
models inspired by an intriguing ability of slime molds to both memorize the period 
of temperature and humidity variations, and anticipate the next variations to come, 
when appropriately trained. Effective circuit models of such behavior are designed 
using i) a set of LC-contours with memristive damping, and ii) a single memcapacitive 
system-based adaptive contour with memristive damping. We consider these two 
approaches in detail by comparing their results and predictions. Finally, possible 
biological experiments that would discriminate between the models are discussed. In 
this work, we also introduce an effective description of certain memory circuit elements. 
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1. Introduction 

Adaptive behavior is common in Nature and may find useful applications if implemented 
in electronics pp. Generally, adaptive behavior is related to memory - the ability to 
store and retrieve relevant information. Recently, it was shown experimentally that an 
amoeboid organism - the slime mold Physarum polycephalum - employs both internal 
[2] and external [3] "memories" to keep information about past events and utilize this 
information in future responses. While the external memory of slime molds is organized 
similarly to that of ant colonies [H [5] (a moving plasmodium leaves behind a thick layer 
of an extracellular slime whose sense determines its future behavioral response [3]), the 
origin of the internal memory is still unclear. In addition to the memory feature, it 
was also demonstrated that slime molds can solve mazes [HI E] and other shortest-path 
problems [El E2, HD] ■ The memory, problem solving and adaptive abilities of Physarum 
polycephalum are surprising since slime molds are unicellular organisms without a neural 
system. 

In experiments on the internal memory [2] , the locomotion speed of slime molds was 
studied as a function of environmental temperature and humidity. It was observed that 
slime molds recognize periodic changes in the environment, memorize their periods, and 
adjust their future behavior based on the memorized information. Taking into account 
the available experimental information, several models can be put forward to describe 
the slime molds' memory and response. In this paper, we will discuss two electronic 
schemes for memory organization in simple organisms inspired by the intriguing internal 
memory abilities of Physarum polycephalum [2J. These electronic models of the slime 
mold adaptation serve two important purposes: i) they are interesting adaptive circuits 
that can find applications in diverse areas of electronics where adaptation to incoming 
signals is of interest, e.g., in pattern recognition; ii) they serve as electronic tools to 
predict possible biological responses that can then be tested in experiments on actual 
organisms. 

First of all, we would like to summarize the available knowledge on behavioral 
abilities of amoebas (in the context of the internal memory). Together with available 
experimental information, we also formulate assumptions (again, in the context of the 
internal memory) that will help in the discussion and formulation of memory models. 
Below, we will then discuss experimental facts (F) (essentially, from Ref. [2]), more 
probable assumptions (A), and speculations/predictions (S). Let us consider these in 
the order from the most reliable to the least reliable. 

Fl: The locomotion speed depends on environmental conditions determined by two 
variables - temperature and humidity. Favorable conditions for faster locomotion are 
higher temperatures and humidities. F2: Subjected to specific periodic environmental 
changes, amoebas "memorize" the period and anticipate new changes to come [2]. 
Periodic slow-downs are observed after both a sequence of three training pulses and 
a single pulse. F3: Amoebas "memorize" a wide range of periods. F4: The memory 
about the period decays in time (longer time intervals between the training sequence and 




Figure 1. Equivalent electronic circuit models of amoeba's learning: (a) single 
LC-contour with memristive damping from Ref. [TT], (b) n coupled LC-contours 
with memristive damping, and (c) memcapacitive system-based adaptive contour with 
memristive damping. In (b) , the oscillators have different resonant frequencies covering 
a frequency spectrum from uj\ rj (L\C\)~ x I 2 to ui n w (L n C rl ) -1 / 2 . Moreover, R c is 
a coupling resistance that reduces R from (a) to R — R c in (b) to ensure the same 
response when a single pulse is applied. In (c), the use of memcapacitive system C(t) 
results in a contour with adaptive frequency. 

testing pulse decrease the memory response [2J). F5: On average, untrained amoebas 
do not slow-down after a single pulse. 

Al: The transition from favorable to unfavorable environmental conditions can 
be parameterized by a single parameter selected in a such way that the equilibrium 
locomotion speed changes monotonously with this parameter. A2: There is an 
internal mechanism for memory decay independent of the instantaneous environmental 
conditions. However, the past memory can be reinforced by an external stimulus of the 
same period. A3: The memory decay rate can be considered as frequency- in dependent. 
A4: In single pulse experiments, untrained amoebas do not exhibit any slow-downs. 
A5: There exists a maximum possible speed for amoebas' locomotion. 

SI: There is a threshold for learning. In other words, periodic but relatively 
small changes in environmental conditions cannot be memorized. S2: If amoebas were 
trained to two different frequencies both frequencies would be revealed in the response. 
S3: In an inverse experiment, namely, if unfavorable conditions were interrupted by 
periodic pulses of favorable conditions amoebas would memorize the period of pulses 
and demonstrate spontaneous acceleration in the anticipation of next pulses to come. 

The current amount of available experimental data is not sufficient to support 
or reject assumptions As and speculations Ss. However, it is expected that a viable 
electronic model of behavioral abilities of amoebas must satisfy all the facts Fs, and 
most (if not all) of the assumptions As. 
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Previously, two possible schemes of adaptive behavior were suggested by two of us 
(YP and MD)|llj. The first approach employs an array of LC-contours with additional 
damping elements (resistor and memristive system [12] in each contour). The second is a 
single adaptive contour involving memcapacitive and/or meminductive systems [T3~t [T4"]. 
In Ref. [UJ, the response of only a single LC-contour with memristive damping element 
was explicitly considered, and the second scheme was only suggested at the end of that 
paper. 

The purpose of this publication is to develop better models of amoeba's learning 
following the two general schemes initially suggested in Ref. [11]. Unlike the previous 
publication [UJ, in this one (see Sec. [3]) we consider a collective response of an array 
of LC-contours covering an interval of frequencies. This consideration is based on a 
different model of memristive system resulting in a closer similarity with experimental 
observations. Several possible realizations of the adaptable LC-contour are considered 
in Sec. |4j In this Section, we also introduce an effective description of certain 
memcapacitive systems (see Sec. 4.1). We conclude in Sec. [5] with a brief summary, 



final remarks and suggestions of additional experiments that would help distinguishing 
between the suggested models, and thus further clarify the origins of learning and 
adaptive behavior in simple organisms. 

2. Equivalent Circuit Description 

Fig. [T] presents three equivalent circuit models of adaptive behavior that are referred to 
in this paper. All of the circuits are based on damped LC-contour(s) associated with 
biological oscillators in Physarum polycephalum. Possible relations between the circuits' 
components and biological processes are the same as in Ref. [11]. The memristive 
systems M and memcapacitive system C summarize the relevant memory mechanisms 
in slime molds while the external voltage V(t) reproduces the external stimuli such as 
temperature and humidity variations. The amoeba's response (the speed of locomotion 
[2]) is related to the voltage across the (mem)capacitor(s). The first circuit, Fig.[T](a), 
represents slime molds that can "memorize" frequencies only in a narrow fixed range. 
The second one, Fig.[T](b), allows learning of more than one frequency in a wide range. 
The third circuit, Fig.[T](c), provides learning of a single frequency but in a wide range. 

The response of all circuits presented in Fig.[T] depends crucially on the type 
of memristive system used (the model of memcapacitive system C(t) for Fig.[l](c) is 
discussed in Sec. [4]). In this work, we will use a voltage-controlled memristive device 
with asymmetric voltage thresholds. Mathematically, such a model is described by the 
following set of equations 

/ =x~ 1 V M , (1) 

x = f(V M )[9(V M )9(x - M 1 )+6(-V M )e(M 2 - x)], (2) 
B -a 

f(V) = -pv+^-(\V+V L \-\V-V R \+V R -V L ), (3) 
where I and Vm are the current through and the voltage drop on the device, respectively, 
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and x is the internal state variable playing the role of memristance, M = x, #(■) is the 
step function, a and /3 characterize the rate of memristance change at lower (\Vm\ is 
below threshold) and higher (|Vm| is above threshold) voltages, Vl and Vr are threshold 
voltages, and Mi and M 2 are limiting values of the memristance M. In Eq. ([2]), the 
^-functions guarantees that the memristance changes only in the interval between Mi 
and M 2 . The shape of /(V) is sketched in Fig. [2} 

The only difference between the memristive device described by Eqs. Q-(|3]) and the 
one used in our previous work [TT] is the presence of asymmetric voltage thresholds (the 
previous model [11] is obtained by setting Vl = Vr in Eqs. ([TJ-Q). Such a modification 
is needed in order to avoid unwanted circuit dynamics. In particular, if a long train of 
voltage pulses with a resonance frequency was applied to the LC-contour (shown in 
Fig.[T](a)) with a symmetric memristive device, the amplitude of oscillations across the 
capacitor would increase driving a sequence of unwanted switchings between Mi to M 2 . 
However, these switchings (interpreted as fast learning and unlearning processes) are 
highly unlikely to be observed in Physarum polycephalum. 

In electronics, there are at least two ways to realize a memristive device with 
asymmetric switching threshold. One approach is to select an experimental memristive 
system with required characteristics from a large amount of presently known memristive 
systems [T5]- Another approach consists in the asymmetrization of a symmetric 
memristive system via its coupling to a non-linear circuit element. For example, it 
can be performed by attaching a resistor in parallel to a diode to a terminal of a 
memristive system with symmetric thresholds. The resulting three elements circuit 
can be considered as a single effective memristive device with switching asymmetry (see 
Fig.§. 

In fact, many emergent non- volatile memory cells [161 El HH1 UHl EQl EH [15] 
seems perfect for analog applications in electronics (including those shown in Fig. [T]) 
because of their long-term information storage capability, threshold-type switching, 
high endurance, low power consumption and short read/write times (normally, all 
these characteristics are desirable for non-traditional computing applications [22]). 
Some of these systems, e.g., nanoionic resistive switches based on amorphous-Si 
(see Ref. |23j), offer an additional benefit: a CMOS compatibility. Importantly, 
examples of memristive devices with asymmetric switching thresholds are known, such 
as Cu/Si02/Pt electrochemical metallization cells |24j . 

In our circuit simulations, the environmental conditions are described by a single 
parameter, the applied voltage V(t). While the standard (favorable) environmental 
condition corresponds to a slightly positive V(t), namely V{t) = Vp, the unfavorable 
conditions are simulated by a negative applied voltage. The choice for the shape of 
unfavorable conditions pulse (a short term variation of temperature and humidity) is 
based on a model of an object in heat contact with variable temperature reservoir, 
which is indeed what is most likely to be done in actual biological experiments. The 
pulse shape parameters are given in Fig. [3] 

The circuits from Fig. [T] respond differently to favorable and unfavorable conditions. 
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Figure 2. (a) Schematics of the switching function f(V) given by Eq. (J3j) . 
Asymmetry in switching thresholds can be obtained by combining a memristive system 
with symmetric switching function (b) with non-linear elements, such as a diode (c). 
The total scheme can be considered as a single effective memristive device. 




Figure 3. The shape of the voltage pulse describing a pulse of unfavorable 
environmental conditions. 
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In the case of favorable conditions applied for a long period of time, memristive elements 
are subjected to a small positive voltage that, according to Eqs. ([T])-([3]), switches these 
elements into the low resistance state M\. In this case, oscillations in LC contour (s) 
are damped. On the other hand, pulses of unfavorable conditions induce a complex 
circuit dynamics depending on many factors such as the amplitude of the pulse Vp, the 
pulse length T/2, separation between the pulses, etc. Ref. [TT] analyzes the response of 
Fig.[l](a) circuit to a periodic and aperiodic sequences of three pulses. It is shown that 
only the periodic sequence with a frequency close to the fundamental frequency of LC 
contour drives the circuit into the undamped state. Such a behavior is related to the 
fact that when resonant pulses are applied, the amplitude of voltage oscillations on the 
capacitor increases with each pulse and at some point exceeds the threshold voltage of 
the memristive device that switches into the high resistance state. 

Finally, we mention that another way to include memory loss mechanisms 
independently of the environmental condition, can be done by employing a memristive 
system with an internal memory decay. In order to take into account the internal 
memory decay, Eq. ^ can be replaced, for example, with 

(P(V-V R )--yx foxV>V R 
f(y)= )p(y + V L )-yx for V < -V L . (4) 

^ — 72 otherwise 

Here, 7 is the relaxation constant responsible for the memory decay, the meaning of all 
other parameters is the same. It is worth noticing that memristive systems with internal 
relaxation are well known. For example, spin memristive systems [25] have a short-term 
memory. In our case study the favorable condition does not vary, so Eq. ^ and Eq. (HI) 
give essentially the same results for a suitable choice of 7. 

Using the memristive device model with threshold asymmetry given by Eqs. 0- 
(j3|, we have performed simulations of circuits presented in Fig.JT} We use the in-house 
NOSTOS (NOnlinear circuit and SysTem Orbit Stability) simulator developed by one of 
the authors (FT) [261 E3 EE]- A qualitatively similar response of all circuits to periodic 
and aperiodic sequences of three pulses (corresponding to the protocol of the biological 
experiment [2]) has been found providing that, initially, the internal frequency of the 
adaptive contour is close to the pulse period (see Sec. [4] for more details). Applying 
different (more complex) training sequences, we have been able to determine cases when 
responses become circuit-specific. We will focus below on such cases including the 
excitations by multiple frequency sequences and tests of learning threshold. 



3. Coupled LC-contours with memristive damping 

In this Section, we consider the response of the circuit presented in Fig.[l](b) to different 
pulse sequences. The choice of pulse sequences is dictated by our desire to better 
understand/predict the slime mold's response and know implications of different models. 
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Figure 4. Simulation of the single LC contour (shown Fig.[T](a)) subjected to a 
periodic sequence of pulses and tested by a single pulse at a longer time. These 
plots have been obtained with R = 0.1ft, L — 2H, C — IF, M x = 3ft, M 2 = 20ft, 
a = O.lft(Vs), P = 100ft/(Vs), V L = 3.5V and = 10.5V. The voltage corresponding 
to the favorable condition was Vp = 0.1V. (a) and (b) show the response to below- 
the-threshold pulse sequence, T = 9s and Vp = 1.6V. c) and d) show response to 
above-the-threshold (learning) pulse sequence response, T = 9s and Vp = 1.8V. The 
input signal is shown by dashed green lines. 



3.1. Testing the learning threshold 

According to SI, there is a threshold for learning and, as a consequence, relatively 
small changes in environmental conditions can not be memorized. This assumption is 
based on the fact that virtually any information storage is associated with a threshold. 
Moreover, biochemical/physical processes in biological organisms leading to memory 
(such as chemical reactions) often involve a threshold barrier to overcome. In order 
to test this assumption, we suggest to study the amoeba's response utilizing a fixed 
frequency sequence at several pulse amplitudes and number of pulses. 

We have found that when a fixed frequency pulse sequence is applied, the response of 
all circuits in Fig.[l]is qualitatively similar providing that, initially, the internal frequency 
of the adaptive contour of Fig.[l](c) is close to the pulse period. Moreover, we assume 
that for the circuit of Fig. [11(b) the distribution of the internal resonance frequencies is 
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Figure 5. Learning region of LC contour. The parameters used in the simulation are 
the same as in Fig. [4] 



dense in a given window of frequencies. This avoids different responses that may appear 
if the pulse frequency is at the boundary between internal frequencies of two contours 
because we assume such behavior is inconsistent with the amoeba dynamic response. 
Therefore, we report only simulations for the simplest circuit - the single LC contour 
with memristive damping shown in Fig.[l](a) - assuming that the pulse frequency is close 
to its internal frequency To better relate to the amoeba experiments, when plotting 
the response of the circuit, we impose a restriction so that the response signal (the 
voltage on the capacitor C in Fig.[T](a)) cannot exceed a certain value, which in our 
particular calculations is selected to be equal to the voltage corresponding to standard 
favorable conditions Vp (see Ref. [11] for more details). Electronically, such a response 
can be obtained using a diode connected from one side to the junction of the inductor, 
capacitor, and memristive system in Fig.[l](a) and a (large) resistor connected between 
another side of the diode and a power source at Vp voltage. 

Fig.|4] reports the response of the Fig.[I](a) circuit trained by a sequence of four 
pulses. The pulse period (T = 9s) is chosen close to the internal frequency of the contour 
f r « {2ii\JC L)^ 1 . In particular, Fig.[i](a) and (b) indicate that smaller amplitude pulses 
(Vp = 1.6V) do not produce significant switching (see the bottom panel of Fig.|3](a)) 
keeping the oscillations strongly damped. This is reasonable since when the amplitude 
of learning pulses is small, the voltage across the memristive device does not exceed the 
threshold voltage Vp = 3.5V and the memristance M is only slightly increased towards 
M 2 . Damped oscillations of the response signal induced by a testing pulse at a longer 
time (Fig.[4](b) panel) are clearly reflected in the Fourier transform of the output signal 
(see the bottom panel of (b)) that does not contain any sharp peaks. 

By contrast, at higher pulse amplitudes, the circuit response becomes similar 
to the one observed in biological experiments [2J. In particular, a spontaneous in- 
phase slowdown (SPS) [2] and an SPS after one disappearance event [2J can be clearly 
recognized in Fig.[I](c) and d, respectively. Such a change in response is a consequence of 
the fact that now the voltage across the memristive device exceeds the threshold voltage 
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Figure 6. RML for n coupled LC contours (Fig.[I](b)). The dashed line confines the 
RML for R c = SI and the solid line for R c = 0.1 f2. The calculations were made using 
the following system parameters: R = O.lfi, L = 2hE, C = hF, Mi = 3f2, M 2 = 50f2, 
a = 0.1fi/(Vs), P = 100fi/(Vs), V L = 3.5V and V R = 10.5V where h takes values in 
the interval [0.5, 2] logarithmically spaced in 12 points. 
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Vl during the training phase (Fig.[4Kc)). In this case, the memristive device is brought 
into the high resistance state M = M 2 (see the bottom panel of Fig.[4](c)). FFT of the 
response signal induced by a testing pulse at a longer time (Fig.[4](d)) exhibit a narrow 
peak close to f r and its multiples. 

The number of pulses iV in the training sequence is an additional parameter 
controlling the learning. We define the Region of Maximum Learning (RML) as the 
region in the Vp — N plane where the switching of the memristive device is maximum 
(the condition M = M 2 takes place during the training phase). It should be emphasized 
that the learning process is a continuum analog process, so that the memory build-up 
is gradual. Fig. [5] depicts RML for a single LC contour. It is worth noticing that, in 
principle, such a region can be easily found experimentally for real biological organisms 
like Physarum polycephalum. Then, the memristive device model could be tailored to 
attain a better match with behavior of specific biological organisms. 



3.2. Multiple frequency response 

Additional information on internal processes leading to learning and memory in simple 
biological organisms can be obtained using more complex pulse sequences combining 
two or more frequencies. Moreover, the knowledge of biological response to such 
sequences would help to understand whether Fig.[T](b) circuit or Fig.[l](c) circuit is a 
closer representation of the real dynamics. Specifically, while Fig.[T](c) circuit can learn 
only a single frequency, Fig.[l](b) circuit can memorize many of these. The frequency 
memory can be tested using an SPS after one disappearance event experiment [2]. 

Let us now consider a circuit consisting of n coupled LC contours with memristive 
damping as shown in Fig.[l](b). The output signal of this circuit (corresponding to the 
locomotion speed of slime molds) is the minimal of voltages on the capacitors C, with a 
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Figure 7. Fourier transform of the voltage response after the application of two 
pulse sequences as described in the text. The calculations use the same parameters 
as in Fig.[6j The voltage corresponding to the favorable condition is Vp = 0.1V. The 
periods used for the two trains are T\ = 6.803s and T2 = 11.261s, respectively. The 
corresponding frequencies are /1 = 0.147Hz and f% = 0.089s. The dashed red lines 
are the response at R c = 0V (no coupling) with pulse amplitudes of Vp 1 — 1.95V and 
Vp 2 = 1.7V. The solid blue lines correspond to R c = 0.1V (maximum coupling) with 
pulse amplitudes of Vp 1 = 1.85V and Vp 2 = 1.65V. The top panel is obtained with 
T s = 150s time separation between pulse sequences, T s — Os for the bottom panel. 



restriction that the response cannot exceed a certain value selected as Vp. Electronically, 
such a response signal can be obtained using n diodes, each connected from one side 
to the junction of the inductor, capacitor, and memristive device in Fig.[I](b) and, from 
the second side, to a common connection of all diodes with a (large) resistor connected 
(using its second terminal) to a power source at Vp voltage. 

Using similar considerations as in Sec. 3.1 we plot RML for n coupled LC contours. 
Fig. [6] presents this result for two values of R c . Note, that the value of the coupling 
parameter, R c (see the circuit in Fig.[l](b)), is responsible for a shift of the boundary of 
RML. 

Based on information regarding the location of the RML region, we have applied 
a voltage input composed of two sequences of three pulses of different periods and 
amplitudes. In particular, by fixing two distinct periods, the corresponding amplitudes 
have been taken corresponding to the coupling limits of the RML in Fig. [6] The 
initial separation T s between two sequences has been selected long enough so that the 
oscillations due to the first sequence are damped before the start of the second one. The 
top panel of Fig. [7] presents the Fourier transform of the response to a separate testing 
pulse after the application of training pulses described above. In this case, the spectrum 
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clearly shows the presence of two peaks corresponding to two training frequencies, and 
also to their sum and difference and to their second harmonics. This spectrum shape 
is essentially due to the fact that only two memristive systems in the contours with 
resonant frequencies close to those of the input sequences are switched into M 2 . Note 
that peaks are sharper at stronger coupling between the contours. 

Reducing the time-separation T s between two sequences, the response of the circuit 
dramatically changes. The bottom panel in Fig. [7] reports the Fourier transform of the 
response to a separate testing pulse after the training by two sequences with T s = Os. 
Compared to the top panel, the number of peaks has increased. The presence of 
many more peaks is due to switching of many memristive systems. The reason is that 
two consecutive pulse sequences induce large enough oscillations, not just in resonant 
contours. 

4. Adaptive contour 

This Section discusses possible realizations of the adaptive contour shown in Fig.[T] 
(c), namely, a single memcapacitive device-based oscillating contour that can adapt its 
frequency to the frequency of the applied signal. Generally, it is difficult to determine a 
model of memcapacitive device providing such functionality. More difficult, however, is 
to find experimental solid-state realizations of such model. The latter task is, however, 
beyond the scope of this paper. The difficulties with memcapacitive models stem from 
the fact that the resulting systems depend on several internal state variables [13] with 
dynamics described by a set of nonlinear differential equations such that the dynamics 
can be unstable or can show some unexpected behavior. Here, we will discuss two 
different models of memcapacitive devices able to change the capacitance according 
to the external frequency. Being the models dependent on several parameters, an 
exhaustive picture of their dynamics would be out of the scope of this paper. For 
this reason, we only discuss some specific sets of parameters that minimally realize the 
experimental facts (F). Ideally, we would like to formulate a model resulting in a stable 
dynamics and fast frequency learning. 

4-1- Effective model of certain memcapacitive systems 

Before giving the description and results of the two memcapacitive models employed 
in this section, we briefly discuss the general equations that govern charge-controlled 
memcapacitive systems [13]. We also discuss under which conditions it is possible to 
derive the equations of an effective charge- and current-controlled memcapacitive system 
starting from a charge-controlled one. This result is especially useful when including 
charge-controlled memcapacitive system models in commercial simulators that generally 
use currents and voltages as unknowns. 

A charge-controlled memcapacitive system is a device governed by the equations 
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m 

V = C^q,t)~\ (5) 
x = /(x,g,t), (6) 

where x is an m-component vector casting all the internal state variables, q is the charge, 
V is the applied voltage, and /(x, q, t) is the m-component vector function describing 
the evolution of internal state variables. We note that certain m-order charge-controlled 
memcapacitive systems can be effectively described as (m — l)-order charge- and current- 
controlled memcapacitive systems (similar transformations can be made for all types of 
memory circuit elements [13] )• In particular, let us assume that Eq. ^ for x m is given 
by 

_ x m ~ q(t) /_x 

•Em ; \') 

T 

where r is a (small) time constant (the change of q on the time scale of r should be 
small). Then, the solution of Eq. ([7]) can be written as 

o 

x m = i J erq (t + t) dt + de~r. (8) 

— oo 

Here, C\ is the integration constant that is set equal to zero. Because of the exponential 
term under the integral in Eq. ^ and the smallness of r, the main contribution to the 
integral is provided at t close to zero. We then Taylor expand q (t + 1) around i = 
and integrate over t to obtain 

x m q{t) r dt +r ^ r df3 +.... [J) 

Clearly, in the limit of small r and well-behaving q(t), the combination 
(q(t) — x m ) jr is the current % = dq/dt. Thus (see Eqs. ^ and (|6|), both C and 
/ can be considered as functions of the current i. This fact can be written explicitly 
omitting x m from the set of internal state variables. Consequently, Eqs. (|5]), ^ can 
be rewritten in the form of an effective (m — l)-order charge- and current-controlled 
memcapacitive system 

V = C eff (±,q,t,ty 1 q J (10) 

* = feff(*,q,ht), (11) 

where x is the set of m — 1 internal state variables, C e //(x, q, i, t) is the effective 
memcapacitance and f e ff(x,q,i,t) is the effective (m — l)-component vector function 
describing the evolution of internal state variables. We found that effective current- 
controlled memcapacitive models are quite useful in studies of adaptive frequency 
functionality. The reduced description of memcapacitive systems based on Eqs. (10) 
and (11) is adopted in the two models discussed below. 
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Figure 8. Bifurcation curves of the circuit of Fig.[T](c) obtained with Hopf oscillator 
model of memcapacitive system. The circuit and memristive system parameters are 
the same as in Fig. [6] The parameters of memcapacitive system are: 7 = 10s _1 , 
£1 = 0.5C -1 , uj = 0.69rad/s, a = 10~ 3 and fi = 1. The bifurcation curves were 
tracked at Vp = 1,2,3V. The bottom and top insets show the stable steady states of 
the variable u) before and after the bifurcation, respectively, for an external frequency 
Lu ext = ujq and £2 = 0.05C -1 and 0.35 C -1 . 



4-2. Hopf oscillator memcapacitive system 

The first model of adaptive contour utilizes a memcapacitive system with an internal 
dynamics similar to that of the Hopf oscillator [291 EQ] (analogous to Coram's oscillator 
in the field of electronics (3U E2])- We employ the effective (reduced) formalism of Eq. 



(10) and Eq. (11) to specify the memcapacitive device. Formally, such a device is an 
effective 3-rd order current-controlled memcapacitive system described by the following 
equations 

^eff = T 2 2 ( 12 ) 

x = 7(/z 2 — r 2 )x — ujQUjy + E\i (13) 

y = 7(/i 2 - r 2 )x - u ujy (14) 

Cj = — e 2 i- — au (uj — 1) (15) 
r 

where x, y and u are dimensionless internal state variables, r 2 = x 2 + y 2 , i is the current, 
L the inductance of the LC contour, and \x and a are dimensionless parameters and 
7, E\, 62 and Wo parameters with proper dimensions. Note, that the internal angular 
frequency of oscillations in the above model is UqU. Moreover, we emphasize that in the 
above equations the current i is more preferable to use compared to the voltage since 
the DC component of the voltage - always present in our case study - induces strong 
instabilities and/or unbounded increase of the internal variables. 



A detailed stability analysis of the Hopf oscillator described by Eqs. ( 13 )-( 15 ) 
at ujq = lrad/s, E\ = e 2 , a = in the presence of a general external perturbation 
i is reported in Refs. [29, 30]. In these publications, a detailed picture of the system 
dynamics is obtained by assuming independence of the perturbation term on the system 
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Figure 9. Three Floquet exponents with the largest real part for Vp = IV and 
^ext = 0.69rad/s. 



variables x, y and oj. It was found that the perturbed system is asymptotically stable, 
the stationary solution converges to an attractor (which, in the case of a periodic 
perturbation, is a limit cycle with the same frequency as that of the perturbation) 
and ujqUJ converges to the (dominant) angular frequency of the perturbation. In this 
situation, 7, e\ and 62 determine the speed of convergence to the attractor, /1 is the 
radius of the unperturbed system, a is a damping constant that, in the absence of 
perturbation, brings the Hopf oscillator back to the unperturbed limit cycle with radius 
/1 and frequency u . 

Unfortunately, the dynamics of our system can be very different from the dynamics 
described above because Eq. (12) builds a dependence between x, y, u and the current 
i through other circuit variables. Since an analytical study is very complex in this 
case, we used a numerical approach based on the Floquet theory to assess the stability 
of the system and determine the convergence of UqU to the frequency of the applied 
voltage. The basic questions are whether the limit cycle obtained by applying periodic 
voltage pulses is an attractor (i.e., the limit cycle is asymptotically stable), and how 
fast trajectories converge to the attractor. The answer to the second question can help 
to find model parameters optimizing the speed of the frequency adaptation. 

The Floquet exponents of the limit cycle contain all necessary information to 
answer both questions from the previous paragraph. Briefly, by linearizing the system 
around a limit cycle we obtain a linear differential system with time-periodic coefficients. 
From Floquet theory, the solution of the linear system is of the form P(t) exp[Ft], where 
P(t) a time-periodic matrix and F a constant matrix. The eigenvalues A& of F are the 
so-called Floquet exponents. Re(A&) determines the stability of the limit cycle: all 
Re(Afc) < lead to asymptotic stability; at least one Re(Afc) > leads to instability. 
Moreover, Im(Afc) is used to classify bifurcations (Re(A&) = 0): Im(Afc) = is a fold 
bifurcation, Im(Afc) = vr is a flip (period doubling) bifurcation, Im(Afe) 7^ 0, ix a Neimark- 
Sacker bifurcation [26J. Finally, by definition of Floquet exponents, the smaller Re(Afc), 
the faster trajectories converge to the limit cycle. 

To calculate the Floquet exponents we used the numerical methods reported in 
Refs. [2S1 I2H I2E] and included in our NOSTOS simulator. This paper reports only our 
most important findings because of the large number of model parameters and their 
combinations. In particular, we found that the exponents do not significantly vary with 
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Figure 10. Simulations of the LC contour from Fig.[l](c) based on Hopf oscillator (left) 
and DPT (right) models of memcapacitive system. The left plot was found employing 
the same parameters as in Fig. [5] and £2 = 0.05 C -1 . Different curves correspond to 
different initial times for the pulse train. The right plot was obtained utilizing DPT 
model parameters ot\ — oti = a 3 = 10 -3 8 -1 , /?i = 1A~ C~ , (3 2 = 1C _ , (3 3 = Is -1 , 
ci = 10 -1 A _1 C _1 , and c 2 = 10 -1 F _1 A _1 C _1 . The applied voltage was a three-pulse 
train plus an isolated pulse. In both cases, the pulse parameters are T = 6.8s and 
Vp = 2.7V. The thick black line indicates the external frequency. 



i) the memristance M and the radius /x, ii) for a < 10 -2 , and iii) for j/e^ > 5Cs~ . 
Fig. [8] depicts the bifurcation curves (i.e., the loci where Re(Afc) = 0) of the LC contour. 
The stability of the limit cycle strongly depends on the frequency and the amplitude of 
the applied voltage and on e 2 . On the one hand, in the stability region (region below 
the bifurcation curve) ujquj approaches the frequency of the voltage source (see bottom 
inset of Fig. [8]) and the attractor is a stable orbit with the same period of the external 
excitation. On the other hand, in the unstable region (above the bifurcation curve) 
the variable to approaches double the excitation frequency (see top inset of Fig. [8|) , and 
the attractor is a stable torus. The reason is that the bifurcation is a Neimark-S acker 
bifurcation, and the torus is spanned by a quasi-periodic trajectory with frequencies 
nu ext + Im(Afc) with 

Fig. [9] shows the first three Floquet exponents with the largest real part. Two of 
them are completely superposed (complex conjugate exponents), cross 0, and give rise to 
the bifurcation described above. It is worth noticing that the Floquet exponents have a 
minimum corresponding to the beginning of the region of maximum convergence speed, 
as highlighted in the figure. This is a remarkable situation. In fact, Eq. ( 15 ) suggests that 
the larger £2, the faster the trajectories converge to the limit cycle. On the contrary, the 
Floquet analysis shows that this is valid only before the minimum. After this minimum 
the situation is inverted. Finally, we recover the region of maximum convergence speed 
enveloping all the minima for the frequencies and amplitudes of interest for our case 
study. 

Using the previous stability analysis we are now ready to study the behavior of 
the circuit from Fig.[l](c) based on the Hopf oscillator memcapacitive system. For 
this purpose, we utilize a set of parameters for which the circuit is stable and the 
memcapacitive system is within the maximum convergence speed region. The left inset 
in Fig. 10 reports the circuit internal frequency, UoU, when the circuit is subjected to 
a three-pulse train plus an isolated pulse sequence. Clearly, the internal frequency cuquj 
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Figure 11. Simulation of the LC contour from Fig.[T](c). While the left side presents 
the Hopf oscillator memcapacitive system results, the right side reports results of the 
DPT memcapacitive system model. The parameters are the same as in Fig. |10| The 
insets represent the applied voltage at T% = 6.8s, T2 = 13.6s and Vp = 2.7V. The thick 
red lines indicate the two pulse frequencies. 



converges to the external frequency (black solid line) very fast - with only three pulses. 
It can be noted from the figure that, depending on the starting instant of the pulse 
train, different curves originate. This is due to the fact that, depending on the time 
instant in which the pulse train is applied, the internal variable y takes a value in the 
interval [— //, fi], so that in Eq. (15) the term depending on i can be initially positive or 
negative, giving rise to the different behaviors. The spread of different curves depends 
on the number of pulses (its width goes to zero as the number of pulses goes to infinity). 
Furthermore, as a consequence of the fast convergence, the response of ujquj is very 
sensitive to the isolated pulse, as shown in Fig. 10 This is also due to the fact that, 
depending on the time instant in which the pulse starts, the internal variable y takes a 
value in the interval [—//,//]. This behavior is amplified when the memristive system is 
switched off because more current can pass through the memcapacitive system. 

From the point of view of a biological interpretation, we observe that the mean 
frequency of an ensemble of responses to an isolated pulse coincides with the external 
frequency. So we suggest that, if the amoeba can be represented by this kind of frequency 
learning circuit, after a single pulse it responds, on average, with the same frequency of 
the train pulse with a certain (large enough) variance. 
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Finally, in Fig. 11 the response to two different pulse trains is reported. When 



the trains are consecutive the first frequency is always the dominant. The fluctuations 



are due to the already discussed Eq. (15) where, depending on the starting time of the 



second pulse train, the term depending on i can be positive or negative and gives rise to 



different fluctuations of the response. On the other hand, as can be seen in Fig. 11 , when 
the pulse trains are well separated, the first train switches off the memristive sytem, and 
as a consequence the second train has only a few chances to switch the system to the 
frequency of the second pulse train. 

4-3. DPT memcapacitive system 

We present here a different model of memcapacitive system that we name DPT (Di 
Ventra-Pershin- Traversa) model. This model describes a memcapacitive system capable 
of modifying its capacitance according to the external signal, and reach a constant 
steady state for periodic input signals. The adaptable LC-contour can be built using 
the circuit of Fig.[l](c) and an effective third-order current-controlled memcapacitive 
system of memcapacitance C e // given by 

Ci + 01X3 

C °" " c 2 + fthtei • ( } 

The equations of motion for the internal state variables selected as 

x\= — oi\Xx + (3\i 2 , (17) 
x 2 — — a 2 x 2 + fh% , (18) 

X3 = - "3^3 + 03%\ . (19) 

Here, are damping coefficients, and are used to define the state of the capacitance 
for a dc signal (zero current). 

One can show that when driven by a sinusoidal voltage, the contour's frequency 
ulc = 1 / a/ LC e f f approaches u ext with time. For the sake of simplicity, let's consider 
the DPT memcapacitive system driven by periodic current, i = zexp (jco ex tt) with j the 



imaginary unit. In this case, in the frequency domain Eqs. ( 17)-( 19 ) read 



cui + ]2uj ext 

£2 = — , (21) 

"2 + J^ext 

x 3 = 7 - . (22) 

(a 2 + juext) 2 {a 3 + j2u ext ) 



Considering c\ 0iX 3 , c 2 02 3 Lx\ and CKj oj ext , and substituting Eq. (20) and Eq. 



(22) into Eq. (16) we find C e // = —1/Lu 2 xt . The minus sign arises from the fact that 
i is complex. Repeating the same calculation for i = £(exp (ju ext t) + exp (—ju ext t)) we 
obtain C eff = l/Lu 2 ext . 

We tested the stability of this circuit with the same procedure described in section 



4.2 and no evidence of instability regions were found. Fig. 10 reports the response to a 
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pulse train plus an isolated pulse. The LC frequency approaches the external frequency 
(black solid line) as fast as the Hopf oscillator. However, it does not show any fluctuation 
as a function of the starting point of the pulses. This is simply due to the form of the 
equations. Moreover, when the system learns the frequency, the isolated pulse does not 
have any apparent effect on the LC frequency (see Fig. 10). 

Fig. 11 (right column) shows the contour frequency response to a sequence of two 
pulse trains at different frequencies. When the second sequence immediately follows 
the first one the behavior is asymmetric. If the first pulse train is at higher frequency 
(HF) (Fig.[TT|(a')) then the contour frequency initially converges to HF, but, when the 
second train with lower frequency (LF) finishes, the contour frequency begins to decrease 
reaching a minimum far from the HF. On the contrary, when the first pulse train is at LF 
(Fig. 11 (c')), the contour frequency converges to the LF and remains quite unperturbed. 
On the other hand, when the pulse trains are well separated (Fig.[TT|(b') and (d')) the 
contour frequency remains quite unperturbed (just some small shifts are detectable when 



the first pulse train is at HF, see Fig. 11 (b')) and the system is able to learn only the 
first frequency. 

We note that a possible way to discriminate between the Hopf oscillator and the 
DPT model, as the one closest to the amoeba's response, is to perform the two- frequency- 



experiment suggested in Fig.[TTJ In particular, if the pulse trains are well separated, 
the Hopf oscillator includes the possibility of learning (randomly) both LF and HF 
frequencies. On the other hand for the DPT model, under the same experimental 
conditions, only the first frequency can be learned. 



5. Conclusions 



In conclusion, we have discussed several models of memory that are both inspired by 
the primitive learning abilities of unicellular organisms, as well as are meant to provide 
biological feedback through the proposal of several experiments that can distinguish 
between the different circuit responses. In particular, we have looked at the response 
of a set of LC-contours with memristive damping, and a single memcapacitive system- 
based adaptive contour with memristive damping. In the latter case, we have also 
suggested a new memcapacitive model that adapts to the frequency of the input signal. 

Overall, both circuits from Figs. [T|(b) and[T|c) satisfy all F-s and A-s mentioned in 
the Introduction (A2 and A3 are achieved by the use of Eq. Q). Moreover, both 
circuits satisfy SI postulating the learning threshold that still needs to be verified 
experimentally. While Fig. [l](b) circuit satisfies S2, Fig. [l|c) circuit does not satisfy 
this criterion. An experimental study of the response of the biological system to two 
frequency pulses needs to be performed to discriminate between the models. Clearly, 
the progress in understanding the memory mechanisms in simple organisms (including 
its threshold switching properties) depends critically on future experiments with real 
organisms. 

In addition to serve as models of biological processes, the considered circuits are 
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clear examples of adaptive passive electronics [33]. They may then find application 
in several areas of technology, e.g., signal processing, pattern recognition, and even 
unconventional computing. 

6. Acknowledgment 

This work has been partially supported by the Spanish government through project 
TEC2011-14253-E and by NSF grants No. DMR-0802830 and ECCS-1202383, and the 
Center for Magnetic Recording Research at UCSD. 

References 

[1] M. Di Ventra and Y. V. Pershin. Biologically-inspired electronics with memory circuit elements. 

In R. Kozma, R. Pino, and G. Pazienza, editors, Advances in Neuromorphic Memristor Science 

and Applications. Springer, 2012. 
[2] T. Saigusa, A. Tero, T. Nakagaki, and Y. Kuramoto. Amoebae anticipate periodic events. Phys. 

Rev. Lett., 100:018101, 2008. 
[3] C.R. Reid, T. Latty, A. Dussutour, and M. Beekman. Slime mold uses an externalized spatial 

memory to navigate in complex environments. Proceedings of the National Academy of Sciences, 

109:17490-17494, 2012. 

[4] D. E. Jackson, S. J. Martin, M. Holcombe, and F. L.W. Ratnieks. Longevity and detection of 
persistent foraging trails in pharaoh's ants, monomorium pharaonis (L.). Animal Behaviour, 
71:351 - 359, 2006. 

[5] N. Monmarche, F. Guinand, and P. Siarry. Artificial Ants. Wiley-ISTE, 2010. 
[6] T Nakagaki, H Yamada, and A Toth. Maze-solving by an amoeboid organism. Nature, 407:470, 
2000. 

[7] T Nakagaki, H Yamada, and A Toth. Path finding by tube morphogenesis in an amoeboid 

organism. Biophys. Chem., 92:47-52, 2001. 
[8] T Nakagaki, R Kobayashi, Y Nishiura, and T Ueda. Obtaining multiple separate food sources: 

Behavioural intelligence in the physarum plasmodium. Proc. Biol. Sci., 271:2305-2310, 2004. 
[9] T Nakagaki, H Yamada, and M Hara. Smart network solutions in an amoeboid organism. Biophys. 

Chem., 107:1-5, 2004. 

[10] T. Nakagaki, M. lima, T. Ueda, Y. Nishiura, T. Saigusa, A. Tero, R. Kobayashi, and K. Showalter. 

Minimum-risk path finding by an adaptive amoebal network. Phys. Rev. Lett., 99:68104, 2007. 
[11] Y. V. Pershin, S. La Fontaine, and M. Di Ventra. Memristive model of amoeba learning. Phys. 

Rev. E, 80:021926, 2009. 

[12] L. O. Chua and S. M. Kang. Memristive devices and systems. Proc. IEEE, 64:209-223, 1976. 
[13] M. Di Ventra, Y.V. Pershin, and L. O. Chua. Circuit elements with memory: Memristors, 

memcapacitors, and meminductors. Proc. IEEE, 97:1717-1724, 2009. 
[14] M. Di Ventra, Y. V. Pershin, and L. O. Chua. Putting memory into circuit elements: memristors, 

memcapacitors and meminductors. Proc. IEEE, 97:1371-1372, 2009. 
[15] Y. V. Pershin and M. Di Ventra. Memory effects in complex materials and nanoscale systems. 

Advances in Physics, 60:145-227, 2011. 
[16] R. Waser and M. Aono. Nanoionics-based resistive switching memories. Nat. Mat., 6:833-840, 

2007. 

[17] J. C. Scott and L. D. Bozano. Nonvolatile memory elements based on organic materials. Adv. 
Mat, 19:1452, 2007. 

[18] A. Sawa. Resistive switching in transition metal oxides. Mat. Today, 11:28-36, 2008. 

[19] S. F. Karg, G. I. Meijer, J. G. Bednorz, C. T. Rettner, A. G. Schrott, E. A. Joseph, C. H. Lam, 



Memory models of adaptive behaviour 



21 



M. Janousch, U. Staub, F. La Mattina, S. F. Alvarado, D. Widmer, R. Stutz, U. Drechsler, 
and D. Caimi. Transition-metal-oxide-based resistance-change memories. IBM J. Res. Dev., 
52:481-492, 2008. 

[20] G. W. Burr, B. N. Kurdi, J. C. Scott, C. H. Lam, K. Gopalakrishnan, and R. S. Shenoy. Overview 

of candidate device technologies for storage-class memory. IBM J. Res. Dev., 52:449-464, 2008. 
[21] J. J. Yang, M. D. Pickett, X. Li, D. A. A. Ohlberg, D. R. Stewart, and R. S. Williams. Memristive 

switching mechanism for metal/oxide/metal nanodevices. Nat. Nanotechnol. , 3:429-433, 2008. 
[22] Y. V. Pcrshin and M. Di Ventra. Neuromorphic, digital and quantum computation with memory 

circuit elements. Proc. IEEE, 100:2071, 2012. 
[23] S. H. Jo, K.-H. Kim, and W. Lu. High-density crossbar arrays based on a si memristive system. 

Nano Lett, 9:870-874, 2009. 
[24] C. Schindler, G Staikov, and R. Waser. Electrode kinetics of CuSi02-based resistive switching 

cells: Overcoming the voltage-time dilemma of electrochemical metallization memories. Appl. 

Phys. Lett, 94:072109, 2009. 
[25] Y. V. Pershin and M. Di Ventra. Spin memristive systems: Spin memory effects in semiconductor 

spintronics. Phys. Rev. B, 78:113309, 2008. 
[26] F. L. Traversa, F. Bonani, and Donati Guerrieri S. A frequency-domain approach to the analysis 

of stability and bifurcations in nonlinear systems described by differential-algebraic equations. 

Int. J. Girc. Theor. Appl, 36:421-439, 2008. 
[27] F. L. Traversa and F. Bonani. Improved harmonic balance implementation of floquet analysis for 

nonlinear circuit simulation. AEU - Int. J. Electron. Commun., 66:357-363, 2012. 
[28] F. L. Traversa and F. Bonani. Selective determination of floquet quantities for the efficient 

assessment of limit cycle stability and of oscillator noise. IEEE Trans. Computer- Aided Design, 

in press, 2012. 

[29] J. Buchli and A. Ijspecrt. A simple, adaptive locomotion toy-system. In S Schaal, A Ijspeert, 
A Billard, A Vijayakumar, J Hallam, and J Meyer, editors, Animals to Animats 8. Proceedings 
of the Eighth International Conference on the Simulation of Adaptive Behavior (SAB04), page 
153162. MIT Press, 2004. 

[30] L. Righctti, J. Buchli, and A. Ijspeert. Dynamic Hebbian learning in adaptive frequency oscillators. 

Physica D, 216:269-281, 2006. 
[31] F. L. Traversa and F. Bonani. Oscillator noise: A nonlinear perturbative theory including orbital 

fluctuations and phase-orbital correlation. IEEE Trans. Circuits Syst. I, Reg. Papers, 58:2485- 

2497, 2011. 

[32] F. L. Traversa and F. Bonani. Asymptotic stochastic characterization of phase and amplitude 
noise in free-running oscillators. Fluctuation and Noise Letters, 10:207-221, 2011. 

[33] T. Driscoll, J. Quinn, S. Klein, H. T. Kim, B. J. Kim, Y. V. Pcrshin, M. Di Ventra, and D. N. 
Basov. Memristive adaptive filters. Appl. Phys. Lett, 97:093502, 2010. 



